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studies of the statics. Numerical simulations confirm these results. The analysis 
of the dynamics allows an interpretation of two different types of phase transitions 
of the model in terms of memory onset at finite and diverging integrated response, 
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symmetry, where replica theory is not applicable. Finally the dynamics and in 
particular the approach to the stationary state of the model with a finite number 
of traits is addressed. 
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1. Introduction 

The dynamics and collective phenomena of interacting agents in models of game theory, 
economy and biology are currently studied intensively in the physics community for 
example in the context of the so-called Minority Game |21 E] • In particular the tools 
of equilibrium and non-equilibrium statistical mechanics have proved to be extremely 
powerful for the analysis of such complex systems with many degrees of freedom. 
Another prominent example of such systems consists in so-called replicator models 
(RM) which are commonly used to describe the evolution of self-reproducing interacting 
species competing within a given framework of limited resources. RM have found 
wide applications in a variety of fields including game theory, socio-biology, pre-biotic 
evolution and optimization theory IHE]. While earlier studies were mostly restricted to 
the deterministic case the first model with random interactions, the so-called random 
replicator model (RRM), was introduced by Diederich and Opper in [HI [Z|. The 
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randomness of the interspecies couplings here reflects an amount of uncertainty about 
the structure of interactions in real ecosystems. The initial RRM and various extensions 
have subsequently been studied in a series of papers [HI IHl HHl UH 1121 UHl HH UHl HEl HI] 
and they have been found to exhibit intriguing features, both from the biological point 
of view as well as from the perspective of statistical mechanics. In particular it has 
been realised that the model exhibits phase behaviour with interesting ergodic and non- 
ergodic phases, different types of phase transitions as well as replica-symmetry breaking. 

From the point of view of statistical mechanics, RRMs can be seen as disordered 
complex systems with quenched random couplings. The variations of RRMs mentioned 
above then differ in the details of the statistics from which the couplings are drawn. 
In the original model of Diederich and Opper the interactions between the species were 
assumed to be pairwise and drawn from a Gaussian distribution, discusses the case 
of higher-order Gaussian interactions and ^T], ^2] and ^Hj are concerned with models 
in which the couplings are of a separable Hebbian structure, reminiscent of those used 
extensively in the context of neural networks fH^ 

Most of this existing work on RRM in the physics literature seems to focus on 
either numerical simulations and/or on the application of static methods borrowed from 
statistical mechanics, most notably replica techniques. The only exception in which 
exact dynamical techniques are employed to deal with the disordered interactions of 
RRM appears to be the early paper [Jj by Opper and Diederich (and the follow-up jH]) 
and the work by Rieger [20], where RRM are addressed using dynamical generating 
functionals a la De Dominicis |2I]. The use of replica methods to study the statics 
of such models relies on the existence of a global Lyapunov (or fitness) function, the 
stationary states of the replicator system are then identified as extrema of this random 
function. This, however, constitutes a severe constraint from the point of view of biology 
as it limits the accessible systems to those with symmetric couplings. Models with (even 
partial) asymmetry in the interactions do not allow one to formulate the dynamics in 
terms of a Lyapunov function so that replica techniques can not be applied in this 
case. Hence, under such circumstances a direct study of the dynamics of the systems is 
required. 

In this paper we discuss a dynamical approach to a class of RRM with Hebbian 
interactions. In the fully connected case the inter-species interactions are purely 
symmetric so that we can compare the results we obtain from a generating functional 
approach to earlier analyses of the statics of the same model ^21 1^- In particular 
we show that both methods lead to the same equations for the observables describing 
the stationary states. The study of the dynamics however enables us to shed some 
additional light on the two different types of phase transitions previously observed in 
the statical analysis of the model, and allows for an interpretation of these transitions in 
terms of an instability of the fixed point reached, and equivalently in terms of ergodicity 
breaking, dependence on initial conditions and of memory onset. We then extend the 
analysis to cases of Hebbian couplings with dilution of an arbitrary symmetry, where 
replica theory is no longer applicable. Finally a discussion of the dynamics of the model 
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with a finite number of traits is presented. Here we can go beyond tlie computation of 
the statistics of fixed-point solutions and can make statements regarding the approach 
to the stationary state. 

2. Model definitions 

The basic ingredients of the model are as follows. We consider a population of 
species, labelled by Roman indices i = 1, . . . ,N, and with concentrations Xj G [0, oo). 
The system evolves in time according to the following replicator equations 

" N 

Y^^J,^x,{t) + aQ{t)-X{t) . (1) 

Here Jij denotes the coupling between species i and j, Jij < corresponds to a pair of 
co-operating species, whereas i and j are competing with each other, if Jij > 0. The 
Cij G {0, 1} specify the dilution of the interactions, they are drawn such that any given 
link Cij is present with probability c G (0,1], further details of their distribution will 
be given below. Following [T21 [13] each species i is then assumed to carry P traits, 
, labelled by an index fi = 1, . . . , P. In the first part of the paper we will take the 
number of traits to be proportional to the system size, i.e. P = acN, where a = 0{1) 
is an additional model parameter. The case P = 0{1) is discussed in the final section 
before the conclusions. The traits {^f } take values { — 1, 1} with equal probability and 
are drawn independently before the dynamics is started and then remain fixed. The 
interaction between species is then given by the Hebb rule 

acN 

j^^ = n11^^^ (2) 

Two species i and j are the more co-operative, the more complementary traits /i with 
^i^^ = — 1 they have. If i and j carry a large number of identical traits, they will 
be competitors. The traits {^f } along with the dilution variables {%} represent the 
quenched disorder of the problem. The latter are drawn from a distribution with the 
following statistics {i ^ j): 

c = (Qi)c = {cji)c . (cijCji)^ - = rc(l - c) (3) 

((. . .)^ stands for an average over the dilution variables), c G (0,1] denotes the 
connectivity, we here focus on the case of extensively many connections per species 
{cN ~ 0{N)). The parameter F controls the symmetry of the dilution, for F = 1 one 
has Cij = Cji, whereas Cij and Cji are uncorrelated for F = 0. Choosing < F < 1 
allows one to interpolate between these two cases. For c = 1 the parameter F becomes 
irrelevant and we recover the fully connected model studied by static means in [T^ I13j. 
We set Cii = 1 and the diagonal elements Ja are fixed to 

J^i = 2u, (4) 



Dynamics of random replicators with Hebbian interactions 



4 



where m > stands for the self- interaction, or so-called co-operation pressure (7| H]. 
The scaling of the self- interaction with c is chosen similar to the choice of PH]! and 
accordingly we do not address the so-called 'extremely dilute limit' limAr^oo c = while 
still lim^r^oo cN = oo sometimes considered in the context of neural networks fHlC2]- 
is an additional model parameter, large values of the self-interaction will favour states in 
which all species concentrations remain positive whereas for small u the disordered non- 
diagonal terms Jij dominate the interactions and some fraction of the species may die 
out asymptotically. The {Ci{t)} in represent Gaussian white noise of zero mean and 
unit variance, so that the concentration of each species is subject to random fluctuations 
of magnitude a. We will mostly concentrate on the case a = but consider a > to 
study the stability of the solutions of the noiseless dynamics. Finally, the Lagrange 
parameter A = {A(t)} is chosen to ensure the normalization 

N 

J2x^{t) = N (5) 

j=i 

at all times, so that the total concentration of species is kept constant as the eco-system 
evolves in time. We note that in absence of the noise (i{t) Eq. may be written as 

= x,(t) im + m , (6) 

where fi{t) = — '^j{cij/c)JijXj{t) is the 'fitness' of species i at time t. The normalization 
constant A(t) is then related to the 'mean fitness' by 

m = -j^J2'^At)fAt)- (7) 

In terms of game theory the variables i can be understood to label different strategies 
and Xi{t) as the fraction of individuals playing strategy i at time t in a given population 
of agents . A player playing strategy i in an ensemble characterized by the vector 
X = (xi, . . . ,xn) then receives a payoff /i(x(t)). Any individual i is the assumed to 
reproduce at a rate proportional to the difference between fi{t) and the mean fitness 
across the population at time t. All offsprings of individual i then inherit the strategy 
of i. 



3. Generating functional analysis 

3.1. Generating functional and single effective species process 

In the thermodynamic limit the time-evolution of the coupled replicator equations 
(H)) is conveniently studied using generating functional techniques originally developed 
for disordered systems by De Dominicis |2II. These allow one to express dynamics in 
terms of macroscopic order parameters such as the correlation and response functions 
of the system and have proved to be extremely powerful not only for the analysis of 

I The analysis can be adapted to the case (ciiJii)/c — 2u = 0{(P) upon replacing u —> uc throughout 
the calculation. 
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spin-glasses and neural networks, but for example also in the context of the Minority 
Game and other agent-based models [2]; generating functionals have also been used to 
study simples cases of RRM in [ZlEDl- In order to generate response functions we first 
add perturbation fields {hi(t)} to the replicator dynamics and start from 



dt 



Xiit) = -Xiit) 



N 



-^JijXjit) + aQit) - \{t) + 



(8) 



The generating functional is then defined as 

\ I paths 

DxDx p{x{0)) exp 



J2 I dtX^{t) 



X exp 



J2 J dtXi{t) iUt) - A(t) + + K{t)) 



(9) 



Following [Z] we have here employed a transformation yi{t) = log Xi(t) (for Xi(t) > 0) 
in order to bring the replicator equations into a suitable form. Note that any Xj which 
is initialized at Xj(t = 0) = will remain zero forever. The functional Z[il)] (with 
i/j = {'j/j(t)}i>o = {{ipi(t), . . . ,ipNit))}t>o) thus represents the Fourier transform of the 
measure describing the probability of a certain path {x(t) = {xi(t), . . . ,XNit))}t>o to 
occur. p(x(0)) describes the distribution of initial conditions from which the dynamics is 
started at time t = 0. Once the disorder-averaged generating functional 2'[i/>] has been 
computed, correlation and response functions may be obtained by taking derivatives 
Z[ip] of with respect to the source and perturbation fields {ipi{t), hi{t)}. 

The procedure of performing the disorder-average in the thermodynamic limit 
^ oo is standard [3 UHl 121 and results in a self-consistent closed system of equations 
for the dynamical order parameters of the problem. For the present system these order 
parameters are given by the Lagrange parameter A = {(A(t))} and the correlation and 
response functions {C, G}: 

M 2^ 



CM 



N 



hm - ^{x,(t)x,{t')), 

i=l 



G{t,t') 



lim 



6hi{t') 



(10) 



Here (. . .) denotes an average over the possibly random initial conditions and over 
realisations of the white noise variables {Ci{t)}- Note that G{t,t') = for t < t' due to 
causality, and that in general we expect the G{t, t') to take negative values, given the 
effective sign of the perturbation hi{t) in (jHJ. Unlike in the case of spherical models of 
spin-glasses |221 no explicit closed differential equations for {A, C, G} can be found in 
the present model. Instead the order parameters are to be computed self-consistently 
from a non-Markovian stochastic process for an effective single-species concentration 
x{t). This process turns out to be given by 



It 



x{t) = - x{t)(^^x{t) + a 



[ dt'[cG(n - G)-^ + r(l - c)G]{t,t')x{t') 
Jo 
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-A(t) + Mt) + aC(t)+r^(t)). (11) 

Here we have assumed that the distribution of initial conditions p(x(0)) factorizes 
over the individual species {i} and that the perturbation fields {hi{t)} take the form 
hi{t) = h{t) for all i. {rj{t)} is Gaussian coloured noise with temporal correlations 

«A(t, t') = ivitHt')) = «[c(]I - G)-iC(n - G^)-i + (1 - c)C] (t, t').(12) 

n denotes the identity matrix, and {C(^)} is white noise of zero mean and unit variance 
and reflects the white noise present in the original multi-species problem. The above 
correlation and response functions C and G can in turn be shown to be given by 

C{t, t') = (x(t)x(t')). , G(t, t') = ^ , (13) 

and A = {A(t)} has to be chosen such that 

(x(t)), = 1 Vt, (14) 

corresponding to the constraint (0) in the original dynamics §. Here (. . denotes an 
average over realisations of the effective process (jlip . i.e. over realisations of the single- 
species coloured noise {r/(t)} and the white noise {C(''^)}- The perturbation field h(t) 
served us only to generate response functions, and will be set to zero from now on. Note 
also that (up to a sign) G{t, t') may equivalently be obtained by taking a derivative of 
{x{t))^ with respect to \{t). 

Eqs. ()lipi2pi3fl4|l thus form a closed set of equations from which {A, C, G} are to 
be obtained. These equations are exact and fully equivalent to the original A^-species 
problem Eq. in the limit oo. The retarded self-interaction and the coloured 

noise are a direct consequence of the quenched disorder in the original problem and 
impede an explicit analytical solution of the self-consistent saddle-point equations for 
the full two-time objects C, G and the function A. In similar disordered systems (such 
as the Minority Game) one therefore has to resort to specific ansatze for the trajectories 
of the effective particles Alternatively, effective dynamical problems in discrete 
time may be addressed using a Monte-Carlo integration of the resulting non-Markovian 
single-particle processes While this method allows one to compute the dynamical 
order parameters numerically without finite-size effects the iteration quickly becomes 
costly in terms of computer time as the number of time-steps is increased. For similar 
disordered systems one is usually limited to (9(100) iterations, the equilibration times 
for suitably discretised versions of the present system however turn out to be much 
larger. 

§ Technically speaking we here only demand that the relation limjv^oo {xi) = 1 be satisfied. 

For N ^ 00 the differences between the condition Q imposed on any sample of the original process 
and this softer constraint are expected to be irrelevant; see also [J for a similar case in the context of 
spherical Minority Games. 
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3.2. Stationary state 

In order to proceed we assume that a stationary time-translation invariant state is 
reached in the long-term limit, i.e. we will be looking for solutions of the following type 

lim C(t + r,t) = C(r), lim G(t + r, t) = G'(r), lim A(t) = A. (15) 

Furthermore we will only address ergodic stationary states, that is states in which 
perturbations have no long-term effects so that the integrated response function 

/■oo 

/ drGir) (16) 

remains finite, |x| < oo, and so that no long-term memory is present, i.e. we will assume 

limG(t,t')=0 Vt'. (17) 

Note again that with the present definitions we expect x to be negative in general, as 
the perturbation hi{t) effectively acts with a negative sign on Xi in Eq. (jHl). At this 
stage a specific ansatz needs to be made to address the stationary states reached by the 
effective process. We will henceforth restrict the analysis to the case a = 0, in which 
the original problem (0) becomes fully deterministic once the disordered interactions 
and random initial conditions have been drawn. In this case it conveniently turns out 
in simulations that all trajectories {xiit)} evolve into fixed points Xi = \imt->oo Xi(t) for 
all i for large enough values of This observation simplifies the analysis considerably, 
as we may now accordingly look for solutions x{t) —>■ x of the effective process, resulting 
in a flat correlation function 

q = C{t) Vr (18) 

in the stationary state. 1/q here serves as a measure of the diversity of the system, 
large values of 1/g ~ 1 indicate a large fraction of surviving species with roughly equal 
concentrations (xj ~ 1 Vi), for small 1/g ^ 1 only a small number of species survives 
asymptotically in the present model (in the present model the number of surviving 
species is extensive); see also ^U] for further details of the interpretation of 1/g. Within 
the fixed point ansatz we also assume that the single-species noise {ri{t)} approaches a 
time- independent value rj, which in turn is a static Gaussian random variable of zero 
mean and variance (cf. Eq. IT2|l ) 



We abbreviate = a ^c^^^^ + (1 — c)gj from now on. Any particular realization of 

r]{t) in the effective process thus leads to a realization of the random variable r], which 

II In the case of symmetric couplings (c = 1 or F = 1) this statement holds for all u. This is due to the 
existence of a Lyapunov function governing the dynamics, and similar behaviour has been observed in 
RRM with Gaussian symmetric couplings . In the case of asymmetric couplings fixed point solutions 
are generally only found in the regime of large self-interaction u, larger than a critical value u* which 
depends on the details of the model [S]. 
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in turn determines the value of the fixed point x reached by that particular trajectory 
of the effective process. In the following we write r] = TiZ with z a standard Gaussian 
variable. Note that for the moment we will only assume the existence of such fixed 
points, their local stability against perturbations will be discussed in detail below. 
Inserting this ansatz into the effective process (jllll one finds (for h{t) = 0) 



f2u 

X — X + a 
\ c 



X 



1-x 



+ r(i-c)xU-A + S2 



0, 



and we conclude that the random variable x can take values of either x 



(20) 



or 



X 



A-S2 



, depending on z. Given that xit) > the latter solution 
can only be realised provided that z < A, where A = A/S (the denominator 



^ + a(cj^ + T(l 

c \ 1-X ^ 

x{z) 



c)X 



comes out positive 
\-T.z 



so that we write 



f + ac^ + r(l-c)x 



[A - T.z\ 



(21) 



following [7j, with 6(?/) the step-function, i.e. 9(?/) = 1 for ?/ > and 6(y) = 
otherwise. We note here that x{z) = is a solution of (j20|) for all values of z. As it will 
turn out later (see Eq. ((SH)) these zero fixed points are unstable against perturbations if 
A — > 0, which justifies fl21|) a posteriori. Note also that we choose initial conditions 
such that Xi{Q) > with probability one for all i, as concentrations set to zero from the 
start remain zero throughout the dynamics. 

Using (PT|) the self-consistency requirements (fT!I|) and fT^ translate into the 
following relations: 



X 



dx 



In explicit form these may be written as 
cq 



a 



a 



a-xY 



(i-xy 

'2u 

ha 

c 



+ (1 - c)q 



+ (l-c) 



-1/2 


'2u I 











X 



X 



1. 



+ r(i-c)x 





-1 


'2u ( 


)] 













X 



1-X 



r(i-c)x 



n 2 



X 



+ r(i-c)x 



X 



/i(A), 
/2(A), 
/o(A). 



(22) 

(23) 
(24) 
(25) 



0, 1,2) with Dz = -$=e ^^/^ a standard Gaussian 



1-X 

Here /„(A) = j^^ Dz{A - zY {n 

measure. We note that cf) = Dz = /o(A) represents the probability of a given species 
i to survive in the long-term limit, i.e. to attain a fixed point value Xi = lim^^oo Xi{t) > 0. 
We will refer to as the fraction of surviving species in the following. For c = 1 Eqs. 
(f^ EH ESI) identical to those found in replica-symmetric studies of the statics of 
the fully connected model fT^ IT^ . For F = 1 they also coincide with the replica results 
reported in ^H] for the model with symmetric dilution (up to a suitable re-scaling of a 
in terms of c). Eqs. (j23l 1241 are readily solved numerically (in terms of A, q and x) 
for all values of the model parameters. 
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Figure 1. Reciprocal of tlie persistent correlation q and fraction of surviving species 
(j) vs u for different values of a. Solid lines are the analytical predictions for the 
ergodic phase u > u*(a,c, F). For a > 1/2 they have been continued into the phase 
with long-term memory and finite x dashed lines (where the ergodic theory is no 
longer valid). Vertical dotted lines mark the discontinuous transitions at u = a/2 for 
a < 1/2. Symbols are from simulations (circles: a — I, squares: a = 0.8, diamonds: 
a — 0.6, triangle up: a = 0.4, left triangle: a — 0.2). Simulations are performed for 
N — 300 species, data are averages over 50 samples of the disorder (20 samples for the 
fraction of surviving species). The discretisation method used here is that of |H], with 
effective time-step At = [c -I- Xi{t)fi{t)] time t. We here use c = 10, the 

discretised dynamics is iterated for 20000 steps. Dynamics is started from independent 
random initial conditions drawn from a flat distribution over the interval Xi{0) G [0, 2]. 



The resulting predictions for the order parameters q and for the fully connected 
case c = 1 are tested against numerical simulations of the process in Fig. ^ (the 
dilute case will be discussed below) ^, and we observe near perfect agreement in the 
regime of large values of u, greater than a critical value u = u*. The numerical value of 
u* will in general depend on the model parameters a, c and F. u* = u*{a, c, F) will be 
determined analytically in the following section. Below u*{a, c, F) systematic deviations 
from the ergodic theory are observed, the reason for these will become clear below. We 
attribute small discrepancies between theory and simulations at values u>u* close to 
the transition points u* to finite-size or finite-running time effects or to numerical errors 
due to the discretisation of the original continuous-time replicator dynamics. We would 
like to point out that Eqs. ((121)- (E3) admit another (unphysical) solution in the fully 
connected case for a < 1/2 and intermediate values of m, which are not shown in the 

^ Note that extinct species die out only asymptotically, limt_>oo Xi{t) — 0, so that Xi{t) remains positive 
for all i at finite simulation times t. The fraction of surviving species plotted in Fig. ^is measured by 
applying a condition Xi > ■)? at the end of the simulation runs. We have tested several values of 'd and 
slight variations of (f> appear hard to avoid as d is varied. For the data in Fig. QJa value d — 0.01 
was used. 



Dynamics of random replicators with Hebbian interactions 



10 



d'/q 



2.0 



1.5 



1.0 



0.5 



0.0 



1 j 1 ] ' 


1 1 1 1 1 


" ii >h\ i 

- \\\\ ! 




: fk 




1 1 1 i ^ 




■a ii 1 i i'? 

- Ii nil 









d/q 



0.2 0.4 0.6 0.1 
U 



2.0 



1.5 



1.0 



0.5 



0.0 



-.1 1 

-% \J. i 


1 

- 








: V.\\. 





0.2 



0.4 



u 



Figure 2. Reduced distance (P/q between stationary states obtained for a fixed 
realization of the disorder, but started from independent initial conditions. The 
connected markers represent results from simulations. Left panel: fully connected 
model (circles: a — 1, squares: a = 0.8, diamonds: a = 0.6, triangle up: 
a = 0.4, left triangle: a — 0.2), right panel: model with dilution (with (a, c, F) = 
(1,0. 5,0), (1,0. 5,1), (1,0. 25, 0.5) for filled circles, squares and diamonds respectively. 
Simulation parameters as in Fig. ^ iV = 400 species for the dilute systems. The 
vertical dashed lines in both panels indicate the locations of the ergodic/non-ergodic 
phase transitions as predicted by the analytical theory. 



figure. 



4. Memory onset and phase diagram 

The ansatz we made to address the stationary states implies an explicit assumption 
regarding the ergodicity of the system. In particular our theory apphes only in a regime 
in which the system does not exhibit any long term memory and in which stationary 
state does not depend on initial conditions. Apart from being locally stable we therefore 
require the fixed point reached in the stationary state to be unique. To test this 
assumption we have performed simulations in which one realization of the disorder 
is fixed and the system is then started from two different random initial conditions 
{xi{0)} and {a;'j(0)} (with all Xi(0), x'j(O) drawn from a flat distribution over the interval 
[0,2]). We depict the resulting distance (P = ~ ^'if between the two flxed 

points {xi\ and {x^} reached in the long-term limit in Fig. |21 (we normalize by q for 
convenience). In an ergodic state without memory we expect this distance to vanish, 
so that initial conditions are irrelevant for the stationary state. As shown in Fig. |21 
this is indeed the case for large u greater than M*(a, c, F), but initial conditions become 
relevant below m*. This suggests a phase transition between an ergodic phase at large 
u and a non-ergodic regime at low values of u. We will now proceed to compute the 
critical value u*(a, c, F) separating these two regimes analytically. 
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4.1. Diverging integrated response 

A breakdown of our ergodic theory may be signalled by a violation of either of the 
assumptions we made to address the stationary states. We will first inspect the 
requirement that the integrated response x be finite. Taking the limit x ^ ~oo (recall 
X < 0) in Eq. (f^H|) shows that such a divergence can occur at finite u only for F = or 
in the fully connected case c = 1 and directly leads to n = ac'^/2. On the other hand 
the combination of Eqs. ()24|1 and ()25j) in the limit x ~^ ~oo implies 

J_ ^ /2(A) . 
«c (/o(A))2- ^ ^ 

Noting that the ratio on the right- hand- side takes only values greater or equal than 2 
(the minimum is attained for A = 0), we conclude that a divergence of x may occur 
only for ac < 1/2. 

For 0=1 such a singularity is indeed observed in the numerical solutions of Eqs. 
()23I24I25|) . precisely at the point where discontinuities in the order parameters occur at 
u* = a/2 in our simulations for a < 1/2, see Fig. ^ For a > 1/2 no divergence of the 
integrated response is found. In the model with dilution (c < 1) no such singularity is 
observed, for F > it is excluded by the arguments given above, for F = it is preceded 
by a different type of transition, as we will discuss below. 

It is in general very tedious to measure response functions directly in simulations. 
To confirm the predicted divergence of x in the fully connected model c = 1, we therefore 
note that in the course of the generating functional calculation the covariance matrix 
A{t,t') = {7]{t)7]{t'))^/a = [(H - G)"^C(1I - G^)-%> of the effective-species noise also 
turns out the indicate the temporal correlations of the following order parameters 

1 ^ 

= (27) 



/N 

More precisely one has 

^ aN 

^M = —Y,{m^{t)m'^{t'))^. {2i 



At the fixed point in the ergodic regime we therefore have (with = limt^oo m'^(t)) 

^ aN 

M^A-rYii^'f) =7^^- (29) 

aN ■^^^ ' '* (1 - y)2 ^ ' 

11=1 ^ ' 

In particular we expect M^O asx~^ — ooatu = Q;/2forQ; < 1/2. This is indeed 
confirmed in simulations, see Fig. 01 No zeroes of M are observed for any value of u 
when a > 1/2. 

+ Note that the parameter m^{t) = N^-^^^ £,iXi{t) is closely related to what is known as an 'overlap 
parameter' in the context of neural networks. 




Figure 3. Overlap parameter aM vs u in the fully connected model (c = 1) for 
different values of a. Solid lines are the analytical predictions H29() for the ergodic 
phase u > u*(a, c, F). Connected markers represent results from simulations (circles: 
a = 1, squares: a = 0.8, diamonds: a = 0.6, triangle up: a = 0.4, left triangle: 
a — 0.2). Simulation parameters as in Fig. ^ 



4-.2. Instability of the fixed point 

In this section we will discuss the local stability of the fixed point reached by the system. 
To this end we will follow [2j and take into account small fiuctuations y{t) about the 
fixed point x attained by the effective species, i.e. we will write x{t) = x + ey{t) in 
Eq. and will accordingly also assume that the single-particle noise is of the form 

ri{t) = 1] + ev{t), with v{t) a (time-dependent) fluctuation about the flxed point value 
f]. The magnitude of these fluctuations e is taken to be small. We will also allow for 
additional white noise e({t) of a small amplitude e (with {((t)((t')) = 6(t — t')), and 
will then study the stability of the flxed point (x, r]) with respect to these fluctuations. 
Note that self-consistency (cf. Eq. p2|l ) dictates that 

{v{t)v{t')) = a[c{n - G)-^D(n - G^)~^ + (1 - c)D](t, t'), (30) 

where we write D{t,t') = {y{t)yit'))^. 

We flrst note that these fluctuations decay exponentially for species which are dying 
out asymptotically, i.e. for whom the flxed point is given by x = 0. In this case insertion 
of x{t) = ey(t) and ri{t) = + ev{t) into (fTTj) gives (to linear order in e) 

j^y{t) = -y{t) (S^ - A) , (31) 

and we have S2; — A > for flxed points x{z) = as seen in (j2^- 

For flxed points x = x{z) > we flnd instead (again to linear order in e) 

j^y{t) = -X (^%{t) +aj^ dt'icGiH - G)-' + r(l - c)G](t, t')y{t') + v{t) + C(t)) , (32) 
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which is conveniently expressed in terms of Fourier transforms {y{uj) ,v{uj) , C{uj), G{uj)} 
of {y{t),v{t),at),G{t)}e.s 

yiu) = ^ ^^"^ + ^L"^ (33) 

iuj/x + 2u/c + acG{uj)/{l-Giuj)) + a{l-c)TGiuj) 

Focusing on u = and using {((t)((t'))^ = 6{t — t') as well as 

'^ = «(l^(0)r>.((^ + (l-c)) (34) 



(which follows from ((201)) we have 



(ar>(0) |c(l - X-)-' + (1 - c)] + 1 



^'"'"<l^'-^"'l'>'^ |2;/c + «cx7(l-x) + a.(l-W - 

where D{uj) is the Fourier transform of the correlation function D{t) = {y{t + T)y{t))^ 
in the stationary state. The factor (j) (the fraction of surviving species) takes into account 
the earlier result that perturbations y{t) about fixed points a: = do not contribute to 
the long-time behaviour of the correlation function D. We then find 

-1 



DiO) 



(^2u/c + «Cy3^ + ar(l - c)x^ - a (c(l - x)~^ + (1 - c)) 



(36) 



so that D{lj = 0) = {\y{uj = 0)\'^)^ diverges when the square bracket on the right- 
hand-side becomes zero. This conditions defines a transition point u = u*{a, c, F) 
and the divergence of D{u! = 0) at u* suggests that the assumed fixed points 
become unstable. D{uj = 0) is predicted to become negative below the transition, 
when (^2u/c + acj^ + T{1 — c)x^ < 0a (c(l — x)^^ + (1 — c)), leading to a further 
contradiction and indicating that our theory cannot be continued below u* *. Using 
saddle point equation (|25p this onset of instability occurs when 

For 0=1 this relation is identical to the condition marking the onset of a de Almeida- 
Thouless (AT) instability of the replica symmetric solution identified in the analysis of 
the statics of the fully connected model P^ . 



4-3. Breakdown of weak-long term memory 

While in the previous section we have related the breakdown of our ergodic theory to 
a local instability of the fixed point reached by the dynamics, we will now inspect for 
an onset of long-term memory at finite integrated response. This type of transition has 

* Further details regarding this type of transition can also be found in [3 |H|: Instabilities of the 
above type have been associated with 1/uj (or similar) divergencies of -D(w) at the transition point 
u = u*{a,c,T) as a; ^ in Gaussian rephcator models, indicating that fluctuations y{t) are no longer 
damped and the fixed points become unstable at m = u*(a,c,T). Above the transition {y{t + T)y{t))^ 
decays as l/r^ as r — > oo, suggesting that the fixed points are local attractors of the dynamics. 
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been observed previously for example in Minority Games with self-impact correction 
or diluted interactions [211 , and can also be interpreted in terms of a breakdown 
of time-translation invariance, see |2I for details. In order to see how solutions with 
memory bifurcate from the time-translation invariant ergodic states we will make the 
following ansatz for the response function 

G{t,t') =Goit-t')+eG{t,t'), (38) 

where eG{t, t') is a small contribution which breaks time-translation invariance. In 
the context of the present replicator model the time-translation invariant part Go 
reflects the contribution of the surviving species to the total response function as 
discussed above. Note that asymptotically extinct species do not contribute to the 
response in time-translation invariant states, as fixed points Xj = are insensitive to 
small perturbations as seen in the previous section. Perturbations apphed during the 
transients of the dynamics, however, can leave their traces in the choice of the particular 
overall asymptotic fixed point x = (xi, . . . ,xn)- the specific set of of surviving species 
and their stationary concentrations may well depend on those early perturbations. This 
effect is accounted for by the function G{t,t') = G{t'), which is taken to depend only 
on the time t' at which the perturbation is applied, but not on the later time t at which 
the effect of the perturbation is measured [2]. 

Starting from ()38p one expands the kernel of the retarded self-interaction in the 
effective process to linear order in G, and finds 

cG(l - G)-i + r(l - c)G = cGo(l - Go)~^ + r(l - c)Go + eR + 0{e^), (39) 

where 

oo n—1 

R{t, f) = r(l - c)G(t, t') + cY,Y. [(Go)"^G(Go)"-™-^] (t, t'). (40) 

n=0 m=0 

Taking into account this extra contribution we find that fixed points are now to be 
determined as (with x = J2t ^o(^)) 



\-ri-ea f * dt'R{t, t')x{t') 

X = 

2u/c + acxiil -x) + ar(l - c)x 



X-r]-ea [ dt' R{t,t')x{t' 
Jo 



' -(41) 



Taking the derivative with respect to a perturbation at time t" followed by averaging 
we then have (to first order in e) 

Git") = — 7T-^. 7 — ^ f dt'na, t') (e\\-r,] . m 

^ ' 2u/c + acx/{l-x) + o,T{l-c)xJ, ^' ^\ ^ / . 

Within our ansatz the average on the right-hand-side is identified as Go{t',t"). Using 
the above expression for R and introducing the shorthand x = Ylt ^(^) then find 
(after suitable integration over t" and averaging over t) 

X = -TT^ . , ^ (^7T^ + r(l - c)x) X. (43) 



2u/c + acx/il -x) + «r(l - c)x \ (l - xV 
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Figure 4. Phase diagram of the modeL The dashed hne u = a/2 for a < 1/2 marks 
the discontinuous transition signaUed by a divergence of the integrated response. The 
sohd hne for a > 1/2 corresponds to the simultaneous onset of long-term memory and 
of an instability of the fixed point against small perturbations. The line u — a/2 has 
been continued as a dot-dashed line for u > a/2. 

Although £ = is always a solution, non-zero branches may bifurcate from the time- 
translation invariant solution at the point at which the coefficient in front of x on the 
right-hand- side of PHjl becomes one. Using Eq. this condition is given by 

For fully symmetric dilution (F = 1) this is identical to the above condition (pTTj) marking 
the onset of the instability of the fixed points and for c = 1 furthermore coincides with 
the condition signalling the AT-inst ability of the replica-symmetric solutions of the 
statics of the fully connected model ^21 E]- For F < 1 (and c < 1) one observes 
that a fulfillment of memory-onset condition (jl^ implies that the instability of the 
fixed points has already set in (as signalled by a negative right-hand-side of (|36|) ). For 
asymmetrically diluted couplings the onset of instability thus occurs first as u is lowered 
at fixed a, c, F and the MO-line pijl has no physical meaning. A physical interpretation 
of the two types of transitions in the case of (partially) asymmetric dilution will be 
discussed briefly below. 

4 ■4- Phase diagram of the fully connected model 

The resulting phase diagram of the fully connected model (c = 1) in the {u, a)-plane is 
shown in Fig. H] and coincides with the one found in the statics ^21 . For values of 
a greater than 1/2 we do not find any divergence of any of the order parameters, but 
rather a continuous onset of long-term memory occurs at a point u* = u*{a) slightly 
above the line u = a/2, accompanied by a simultaneous onset of an instability of the 
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assumed fixed point against small fluctuations. All order parameters are continuous 
across this transition. 

For a < 1/2 one flnds a divergence x ^ at u*{a) = a/2 as discussed above. 
This transition is marked by discontinuities in the order parameters such as q and 
0, see Fig. ^ We also note that the overlap parameter M vanishes at this point 
u = u*{a) for a < 1/2, but that simulations suggest that it remains strictly positive 
below this transition {u < u*{a)) as indicated in Fig. El This is at variance with the 
behaviour of the analogous quantity H in Minority Games PI E] , which is positive above 
the corresponding transition of the Minority Game, vanishes at the point at which x 
diverges and then remains identically zero below the transition pointjj. In simulations 
(not shown here) we also do not observe any discontinuities of g or as a is varied at 
constant u strictly within in the non-ergodic phase (i.e. not crossing the line segment 
u = a/2, < a < 1/2). In this sense the non-ergodic phase indicated in Fig. IHdoes 
not appear to be divided into two separate regions in an obvious way (for example one 
with X = —oo,M = and another with x flnite and M > 0). 

As shown in Figs. and in the left panel of Fig. |21 the analytically obtained 
location u*{a, c = 1) of the phase transition in the fully connected model agrees (within 
the accuracy of our simulations) with the onset of deviations from the ergodic theory 
and of the sensitivity to initial conditions ff^^. 

The general picture that emerges here seems to indicate that in the ergodic regime 
u > u*{a,c = 1) only one flxed point is found, so that the microscopic dynamics ends 
up in the same conflguration independently of initial conditions. Below u*{a,c = 1) 
all trajectories still evolve into microscopic flxed points, but these do not seem to be 
unique, but possibly of an exponential (in N) number [HIIZ|, leading to the identifled 
dynamic instabilities and the breaking of ergodicity (and to a breakdown of the replica- 
symmetric solution in the statics). Further studies of the non-ergodic regime, possibly 
along the lines of jHI might however be appropriate to understand the nature of this 
phase in more detail. Given the memory effects below u* an analysis of the dynamics 
below the transition is very likely to require a solution in terms of the full two-time 
quantities C{t,t') and G{t,t') during the transients of the system's temporal evolution. 

jj The so-called 'predictability' H studied in Minority Games is analogous to the overlap parameter 
M discussed here in the sense that both quantities are proportional to the covariance of the effective 
single-particle noises of the respective models at infinite time-separation. 

ft Note that cP as depicted in Fig. El is a measure for the distance between the microscopic fixed points 
reached from different realisations of the random initial conditions. In contrast to Minority Games 
where the so-called 'market volatility' crucially depends on the starting point in the non-ergodic regime 
of the game we have not been able to identify an observable which can be expressed in terms of the 
dynamic order parameters {C, G} (and possibly A) and which shows a dependence on the type of initial 
conditions below u* . 

+^ote also that in |24j small perturbations were applied in a similar situation in the context of the 
Minority Game to verify the onset of memory. We have tried to measure the response of the present 
system to small perturbations at early and late times respectively, but found the resulting simulations 
to be inconclusive. The data in Fig. El is therefore restricted to separate starts from two independent 
sets of initial conditions at fixed disorder. 
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4-5. Effects of dilution 

We will now turn to the consequences of diluting the Hebbian couplings. A brief 
discussion of these effects can also be found in [13], albeit based on replica methods 
and hence restricted to the case of symmetric dilution. 

First note that the relations ()H7j) and ()44j] signalling the instability of the fixed 
points and the onset of memory respectively coincide for symmetric dilution F = 1. In 
this case a Lyapunov function of the replicator dynamics can be found and the system 
evolves into a fixed point irrespective of {u,a,c}. Below u*{a,c,T = 1) exponentially 
many fixed points exist and initial conditions as well as perturbations in the transients 
determine which of these is reached by the dynamics, resulting in broken ergodicity and 
memory effects. For F < 1 the instability condition (jHTj) is fulfilled first as u is lowered 
from large values (at constant a, c, F < 1). While above u* one single stable fixed point 
is found, the number of fixed points is expected to be exponentially (in A^) suppressed 
for asymmetric couplings below the transition [3 |H] . Since no phase with multiple fixed 
points is found for F < 1 no MO-transition occurs (the identification of which was based 
on a fixed-point assumption also below u*) and the line in the phase diagram defined by 
()44|1 has no physical meaning as it is preceded by condition (jSZj). The relation between 
the MO- and instability condition is discussed in more detail also in [20] • Furthermore 
no singularities x ~oo are found for c < 1 before the instability condition sets in, 
resulting in the location of all transitions being determined by (jHTj) in this case. 

The phase diagrams for fully symmetric and fully asymmetric dilution are shown 
in Fig. El With the present scaling of the self-interactions (with c) the general effect 
of increasing dilution appears to be an increase the range of ergodicity, only in a region 
directly below the transition line of the fully connected model do we find re-entrance 
behaviour: here the system is ergodic at c > C2 and fixed {u,a), becomes non-ergodic 
at in an intermediate interval c G [ci,C2] and then ergodic again for c < ci. We have 
performed some simulations to confirm these findings (not shown here). While the 
numerical experiments are consistent with re-entrance behaviour the exact location of 
the window of non-ergodicity is hard to verify numerically especially because C2 is found 
to lie close to c = 1 in the analytical solution. 

Finally we plot the reciprocal order parameter 1/q versus the connectivity c at 
fixed {u, a, F) in Fig. IHl While the scaling of the self-interaction used here, both 
purely decreasing behaviour with increasing connectivity as well as extremal diversity 
at intermediate c can be found depending on the values of u and a. Similar non- 
monotonic behaviour is also reported in ^21 for the case of symmetric dilution, although 
we note here that adapting our theory to a model with JuCa/c = 0(c°) suggest that 
this non-monotonicity and the above re-entrance effects appear are to be absent if the 
self- interact ion does not scale with c (results not shown). In general one observes that 
the diversity 1/q (and the fraction of surviving species) is higher for asymmetric than 
for symmetric dilution. 




Figure 5. Phase diagrams of the models with fully asymmetric and with fully 
symmetric dilution. The curves in the (m, a)-plane mark the onset of memory at 
constant c — 0.25, 0.5, 0.75. Ergodic phases are found to the bottom-right of the 
curves. The transition line of the fully connected model c = 1 is shown for comparison. 
The grey areas are sketches of the re-entrance regions, here the system is ergodic for 
small c ^ 1, non-ergodic in an intermediate regime and ergodic again at large c close 
to c = 1. 



5. Finite number of traits 



We now turn to the case of a finite number p of traits. In this case generating functionals 
are not required to formulate a closed dynamical theory, instead it is sufficient to study 
the evolution of the probability distributions of species concentrations on so-called sub- 
lattices, in which all species with the same trait vector = . . . , ^f~^) are treated 
collectively. We here concentrate on the fully connected model. 
The replicator equations take the form 

^-Xi{t) = -Xiit) I y ' JijXjit) - ^ > " JjkXj{t)xk{t) 1 (45) 



dt 



j jk 



with 



Ji, = N~' ^r^^' ' ^ 3, Ju = 2u. (46) 

It is known from the statics that a model with a finite number of traits chosen with 
equal probability from G { — 1,1} leads to a trivial stationary state (with fixed points 
Xi = 1 for all i) [llj so that we follow [TT] and introduce a bias parameter a G [0, 1] and 
draw the traits independently from a distribution 

m) = + (47) 
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Figure 6. Inverse order parameter 1/q at fixed (u,a,r) as a function of tlie 
connectivity for the dilute system. Left: u — 0.2, a = 0.5, right: u ~ 0.5, a = 0.5. 
Sohd hnes are obtained from the ergodic theory and have been continued as dashed 
hnes into the non-ergodic phase. Symbols are from simulations with N = 500 species, 
nm for 20000 discretisation steps, averaged over 50 samples of the disorder (circles: 
r = 0, squares: F — 0.5, diamonds: F = 1). 



for all i and /x. 

Analytical progress can here be made without the use of generating functionals. It 
is sufficient to introduce sub-lattices 



If] 



{t:^, = ri}c{l,...,N} 



with T] G {—1,1}'' and to consider the macroscopic observables 
pr]{x,t) = / l/ryT^ 5{x-Xi{t)) 



(48) 



(49) 



iei> 



rj 



in terms of which closed dynamical equations can be formulated along the lines of |19j . 
(. . .) here denotes an average with respect to the time- dependent microscopic state 
density pt{xi, . . . , x^)- With the relative proportions prj = limAr^oo 1-^771/-^ the Fokker- 
Planck equation governing the evolution ofpt{xi,...,XN) can be reduced to the following 
set of 2^ equations closed in the 2^ probability distributions {pr]{x,t) : ry G { — 1, 1}'''}, 
valid in the thermodynamic limit — oo: 



d 
It 



X) 



d_ 

dx 



X 



(—2ux — Y^Pj^' V v' J dx p^i{x')x 



(50) 



rj',r}" 



dx' p^/{x')x' I dx" p^//{x")x" (51) 



Dynamics of random replicators with Hebbian interactions 



20 



7]' 



„/2 



(52) 



We have here suppressed the time-dependence of the densities pr]{x) and use the 
shorthand rj ■ rj' = X])^=i VtJ.v'ii- Upon the introduction of the moments 



{k = 0,1,2,.. .) one has 
d 



dx pri{x)x^ 



(53) 



d_ 

dx 



( 



X 



-lux -^Prj' il- V'^^^i 



rj'r}" 



IT 



(54) 



Due to the effective non-hnearity (in x) on the right-hand-side a simple solution in terms 
for example of an Ornstein-Uhlenbeck process jlH] appears impossible. Multiplication 
of ()54|) by x^ on both sides and subsequent integration over x then leads to 



—2kuv. 



(fc+i) 



—kv. 



(k) 



tJ.fl ^/ 



(55) 



with = ^■qPrjVtJ.'^'q^ ■ Eqs. (f^ form a closed, but hierarchical system of equations 
for the time-evolution of the moments {i^rj\t)}. 

We will now assume symmetrical initial conditions m^{t = 0) = m(0) for all /i, and 
will accordingly write m^{t) = m{t) for all /i for all times t. Furthermore the densities 
Prjix) will depend on the sub-lattice structure only via the number of entries -|-1 in the 
vector f], i.e. all indices r] may effectively be replaced by n{r]) = : rj^ = and the 
Prj translate into probabilities 



n 
p 



1 + a 



p—n 



n = 0,1,2, 



(56) 



2 / V 2 

for the occurance of a trait vector rj with n entries equal to +1 (and p — n entries equal 
to —1). The overlap can then we written as 

'2n 



m{t) =Yw^u^\t) 

n=0 ^ ^ 



- 1 



(57) 



(where we have used limjv_,oo \Ir]\ ^J2ieI'q^^^ ~ (2'^(^)/p) — 1 V/x). The dynamical 
equations for the first two moments simplify to 

d 



dt^ " " 



mp 



d 
~dt 



(2) 



4mz/?) - 2z/?) 



(— -l) -pm2-2n^lV„,z/i? 

^ ^ n'=0 

P 



2n 
p 



n'=0 



(58) 
(59) 
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Note that this set of equations does not close as the evolution of the second moments 
couples to the third moments, the evaluation of which requires the fourth moments and 
so on. In general one has 

p 

mp 



dt " 



(--l)-pm'-2uj2Wn'^lS^ 

^ ^ ^ n'=0 



(60) 



A brief remark on the stationary state are is in order at this point, 
straightforward to verify that the static solution p„(x) = 6{x — x„) with 

pa{a + 1) — 2an 



Indeed it is 



Xr. 



1 + 



n 



0,1, 



found in ^1] and resulting in m = 2ua/{2u + 1 — a^) is a fixed point of the above 
dynamical equations. We here assume that 



1 2u 

p< 1 + - + — 

a a 1 — 



(62) 



so that all species survive in the long-term limit. A more detailed discussion regarding 
the fraction of surviving species whenever this condition is not fulfilled can be found in 

In order to proceed with the analysis of the dynamics an approximation is required 
at this stage, effectively truncating the above hierarchical set of equations. We here 
restrict the further discussion to the most simple approximative scheme and take the 
densities pn{x) to be Gaussian. This allows to express each third moment Un in terms 
of Un'' and and we find the following approximate but closed set of 2{p+l) equations 



(1) ,,(2) 



'},n 



for the {un' ,i^n 



0,1, 



,p: 



(2n 
mp 1 

V P 



pm 



(2) 



2u}_^Wr,.u):, 



^,y(2) 

dt " 



4«[^i^n3^f -2(z.«)^)]-2^f 



mp 



2n ^ 
p 



pm 



(2) 



(63) 

;64) 



We will write al 



,(2) 



Z/, 



(1)X2 



in the following. The Gaussian approximation can be 



expected to be accurate at most in a regime where the Pn{x) are highly peaked around 



positive means, i.e. in which z/„ > and cr'^/iyn Y ^ 1- In particular any Gaussian 
approximation with o"^ > is inconsistent in the sense that it assigns finite probability to 
negative species concentrations, which are excluded a priori by the replicator equations. 
Note however that our approximative ansatz consists only of assuming the relations 
between the first three moments of Gaussian distributions to hold for the densities 
Pn{,x). No other properties of Gaussian distributions are used here. 

In regimes in which (I62j) is fulfilled the numerical solution of (I63|64|l evolves towards 
a fixed point Vn^ = x„ > 0, cr^ = asymptotically as shown in Fig. [7|so that the validity 
of the Gaussian ansatz is verified a posteriori. We expect the numerical solution of the 
approximate equations ()63I64|) to capture the dynamical behaviour of the system at least 
in the asymptotic regime of large times. This is indeed confirmed by comparison with 
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t 



Figure 7. Temporal evolution of the moments {vn ,<^n} (^^^ text for definitions) for 
the replicator system withp = 4 traits at fixed u = 0.2, a = 0.1. Solid lines are obtained 
from a numerical solution of Eqs. H63I64I57|I (time-stepping dt — 10^^). Different lines 
are for n = 0, 1, . . . , 4 from top to bottom in the left panel and from top to bottom at 
intermediate times in the right panel. Horizontal lines in the left panel are the fixed 
point values given by Eq. Symbols are from simulations of the replicator system 

with p — 4 patterns, N = 300, averages over 50 samples of the disorder are taken 
(with circles, squares, diamonds, up and left triangles corresponding to n = 0, 1, . . . , 4 
respectively; numerical results for the variance (right panel) are shown only for n = 0). 
Initial concentrations are drawn from a fiat distribution over the interval [0.5,1.5], 
corresponding to v^^'' (t = 0) = 1 and al{t = 0) = 0.083 for all n = 0, . . . , 4. 

measurements of (t) in numerical simulations, see the left panel of Fig. [3 (We note 
here that the width of the distributions p„(a;) measured in our numerical experiments 
appears to remain finite (a^ ~ 0.01) up to the time interval covered in simulations 
as shown in the right panel of Fig. [3 A similar effect was observed in ^T], and is 
presumably due to finite-size or finite running-time effects or to discretisation errors in 
the numerical scheme used to iterate the replicator equations.) 

6. Concluding remarks 

To summarise we have used dynamical techniques to study systems of interacting 
replicators subject to random Hebbian couplings with and without dilution. Our 
study focuses on the statistical mechanics properties of the model and complements 
existing replica analyses of the fully connected model. In the fully connected case 
both approaches lead to the same equations describing the ergodic stationary states 
of the system and accordingly the phase diagrams obtained from the statics and the 
dynamics respectively coincide. In addition we have identified two different types of 
phase transitions and patterns of ergodicity breaking in the fully connected model, one 
signalled by a diverging integrated response, the other marked by an onset of long-term 
memory at finite x well as by a dynamical instability of the fixed point solutions 
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against small perturbations. This latter dynamical transition corresponds to an AT- 
instability of the replica-symmetric solution found in the statics. 

The generating functional approach used here allows one to go beyond the models 
accessible by static replica techniques, and we have extended the analysis to the case of 
Hebbian couplings with dilution of an arbitrary symmetry. We find that no divergencies 
of the integrated response occur in diluted models, but that the transition marked by 
an instability of the fixed points persists. With the scaling of self-interactions used 
here dilution in general increases the range of ergodic behaviour in the {u, a)-plane, 
up to a small region of re-entrance. The order parameters show non-trivial behaviour 
as a function of the connectivity. Asymmetry in the dilutions appears to promote an 
increased survival probability of any individual species. 

Finally we have presented a discussion of the dynamics of a replicator system with 
a finite number of traits. Techniques developed originally for neural networks can be 
used to formulate an exact hierarchical set of equations for the concentration-densities 
on sub-lattices resulting from the quenched assignment of traits. Within a Gaussian 
ansatz approximate, but closed equations for the evolution of the first two moments of 
these densities can be found, and allow one to study the approach to the stationary 
state analytically and in good agreement with numerical simulations. 

Several extensions of the present work are possible and of potential interest. 
While we have here addressed only the case of extensively connected species the 
phenomenology of the the finite-connectivity case cN ~ might be worthwhile 

studying with dynamical methods now becoming available for finite-connectivity systems 
P7j . Furthermore replicator systems with heterogeneous species- dependent degree of 
connectivity Cj could be taken into account leading to an ensemble of effective processes 
PH] , as well as the possibility of species not carrying all traits but only a certain 
individual subset. Finally an 'on-line' version of the present model could be devised 
in discrete time, i.e. one in which at each step only one active trait fi{t) is relevant for 
the evolution of the replicator system (as opposed to the present 'batch' model in which 
an effective contraction over all traits is considered). 
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